Automated Assessment of Process Modeling Exams: Basic Ideas and Prototypical Implementation
نویسندگان
چکیده
The assessment of process modeling exams is a time consuming and complex task. It is desirable to give each student a detailed feedback on their solution in terms of syntactic, semantic, and pragmatic quality. It is obvious that especially in the case of mass courses with hundreds of participants, individual grading of modeling exams by humans is challenging: Besides reliability, consistency, and validity, the efficiency of the grading process must be guaranteed. Against that background, this paper aims at developing first ideas for an automated assessment of process modeling exams. The goal is to improve modeling education while teaching students not only to model correctly but to develop good models. Our ideas were prototypically implemented and applied in an exemplary scenario with promising results. It was possible to identify limitations but also to derive reliable semi-automated approaches for the assessment of process modeling exams.
منابع مشابه
Presentation of an efficient automatic short answer grading model based on combination of pseudo relevance feedback and semantic relatedness measures
Automatic short answer grading (ASAG) is the automated process of assessing answers based on natural language using computation methods and machine learning algorithms. Development of large-scale smart education systems on one hand and the importance of assessment as a key factor in the learning process and its confronted challenges, on the other hand, have significantly increased the need for ...
متن کاملPresentation of an efficient automatic short answer grading model based on combination of pseudo relevance feedback and semantic relatedness measures
Automatic short answer grading (ASAG) is the automated process of assessing answers based on natural language using computation methods and machine learning algorithms. Development of large-scale smart education systems on one hand and the importance of assessment as a key factor in the learning process and its confronted challenges, on the other hand, have significantly increased the need for ...
متن کاملProcess Capability Studies in an Automated Flexible Assembly Process: A Case Study in an Automotive Industry
Statistical Process Control (SPC) methods can significantly increase organizational efficiency if appropriately used. The primary goal of process capability studies is to obtain critical information about processes to render them even more effective. This paper proposes a comprehensive framework for proper implementation of SPC studies, including the design of the sampling procedure and interva...
متن کاملImplementing Health in All Policies – Time and Ideas Matter Too!; Comment on “Understanding the Role of Public Administration in Implementing Action on the Social Determinants of Health and Health Inequities”
Carey and Friel suggest that we turn to knowledge developed in the field of public administration, especially new public governance, to better understand the process of implementing health in all policies (HiAP). In this commentary, I claim that theories from the policy studies bring a broader view of the policy process, complementary to that of new public governance. Drawing on the policy stud...
متن کاملMonte Carlo Simulation to Compare Markovian and Neural Network Models for Reliability Assessment in Multiple AGV Manufacturing System
We compare two approaches for a Markovian model in flexible manufacturing systems (FMSs) using Monte Carlo simulation. The model which is a development of Fazlollahtabar and Saidi-Mehrabad (2013), considers two features of automated flexible manufacturing systems equipped with automated guided vehicle (AGV) namely, the reliability of machines and the reliability of AGVs in a multiple AGV jobsho...
متن کامل